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CLASSIFICATION OF DEVIATIONS IN A PROCESS 



Related Cases 

This patent claims the benefit of U.S. provisional patent application 60/438,358, entitled 
"Classification of Deviations in a Process", filed on January 7, 2003, and which is hereby 
incorporated by reference into this patent. 

Background of the Invention 

7. Field of the Invention 

The invention is related to the field of process analysis, and in particular, to technology 
that classifies deviations in the process. 
2. Statement of the Problem 

Sensors measure the characteristics of a process. Such processes include water supply 
systems, manufacturing operations, electrical distribution systems, and communication systems. 
For example, water supply systems use sensors to measure pressure, temperature, and flow rate. 
Unfortunately, sensors have not been developed to detect every abnormal condition. There may 
not be available sensors to detect if a specific component fails, or to detect a specific 
contaminant in the process. Typically, it is too complex and expensive to develop a new sensor 
for each new abnormal condition of interest. 

Summary of the Solution 

Some examples of the invention include process analysis systems and their methods of 
operation. The process analysis systems include a plurality of sensors and a processing system. 
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The sensors are configured to monitor the process to generate sensor signals. The processing 
system is configured to process the sensor signals to detect a deviation from a baseline for the 
process, generate a process vector for the deviation in response to detecting the deviation, and 
compare the process vector to a plurality of library vectors to classify the deviation. 

In some examples of the invention, the process comprises a system that supplies water. 

In some examples of the invention, the sensor signals indicate pH, conductivity, turbidity, 
chlorine, and total organic carbon of the water. 

In some examples of the invention, the classified deviation comprises a contaminant in 
the water. 

In some examples of the invention, the processing system is configured to signal a 
control system to operate a valve in response to classifying the deviation as a contaminant in the 
water. 

In some examples of the invention, the processing system is configured to signal a 
control system to add a marker to the, water in response to classifying the deviation as a 
contaminant in the water. 

In some examples of the invention, the marker comprises a colorant. 

In some examples of the invention, the processing system is configured to signal a 
control system to perform a treatment on the water in response to classifying the deviation as a 
contaminant in the water. 

In some examples of the invention, the treatment comprises adding a disinfectant to the 

water. 

In some examples of the invention, the treatment comprises adding chlorine to the water. 
In some examples of the invention, the treatment comprises exposing the water to 
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ultraviolet radiation. 

In some examples of the invention, the processing system is configured to process the 
sensor signals to produce a single variable and compare the single variable to a threshold to 
detect the deviation from the baseline. 

In some examples of the invention, the process vector comprises a unit vector. 

In some examples of the invention, the processing system is configured to compare an 
angle between the process vector and one of the library vectors to a threshold. 

In some examples of the invention, the library vectors are associated with abnormal 
operations and the processing system is configured to identify one of the abnormal operations 
that is associated with one of the library vectors that matches the process vector to classify the 
deviation. 

In some examples of the invention, the processing system is configured to store the 
process vector as a new one of the library vectors and associate an abnormal operation with the 
new library vector in response to an unknown classification. 

Description of the Drawings 

The same reference number represents the same element on all drawings. 
FIG. 1 illustrates a process analysis system in an example of the invention. 
FIG. 2 illustrates a processing system in an example of the invention. 
FIG. 3 illustrates a signal processing and trigger detection system in an example of the 
invention. 

FIG. 4 illustrates a classification system in an example of the invention. 

FIG. 5 illustrates a water supply analysis system in an example of the invention. 
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Detailed Description of the Invention 

FIGS. 1-5 and the following description depict specific examples to teach those skilled in 
the art how to make and use the best mode of the invention. For the purpose of teaching 
5 inventive principles, some conventional aspects have been simplified or omitted. Those skilled 

in the art will appreciate variations from these examples that fall within the scope of the 
invention. Those skilled in the art will appreciate that the features described below can be 
combined in various ways to form multiple variations of the invention. As a result, the invention 
is not limited to the specific examples described below, but only by the claims and their 
10 equivalents. 

Example #1 

FIG. 1 illustrates process analysis system 100 in an example of the invention. Process . 
analysis system 100 includes process 101, sensors 102-104, processing system 105, and control 
15 systems 106-108. The number of sensors and control systems shown on FIG. 1 has been 

restricted for clarity. 

Process 101 is a dynamic operation that is characterized by multiple parameters that can 
be measured by sensors 102-104. Process 101 could be a water supply system, manufacturing 
operation, electrical distribution system, communication system, or some other process that is 
20 suitable for the analysis of system 1 00. 

Sensors 102-104 measure characteristics of process 101 and transfer sensor signals 1 1 1 to 
processing system 105. Sensor signals 1 1 1 indicate the measured characteristics, and thus, 
provide information about the current state of process 101 . For a water supply system, sensors 
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102-104 may measure pH, conductivity, turbidity, chlorine, total organic carbon and other 
characteristics of the water flowing through a water main. 

Control systems 106-108 exert control over process 101 in response to control signals 
1 12 from processing system 105. For a water supply system, control systems 106-108 may 
operate valves on the water main, add a selected marker to the water in the water main, or 
perform some other treatment. The marker could include a colorant to mark contaminated water. 
The treatment could counteract contaminants through the addition of a disinfectant to the water, 
the exposure of the water to ultraviolet radiation, or some other treatment. 

Processing system 105 processes sensor signals 1 1 1 to identify a deviation from a 
baseline for process 101. In response to identifying the deviation, processing system 105 
generates a process vector for the deviation and compares the process vector to a plurality of 
library vectors to classify the deviation. Processing system 105 may provide control signals 112 
to control systems 106-108 based on the classified deviation. Processing system 105 may also 
provide analysis data 1 13 to process operations. 

For the water supply system, processing system 1 05 may identify and classify a deviation 
indicating water contamination, and in response, instruct control systems 106-108 to operate 
valves that will shut off or divert the supply of contaminated water. In addition, processing 
system 105 may provide a contamination alarm to water supply operations. 

Processing system 105 could include a computer, microprocessor, digital signal 
processor, application specific integrated circuitry, special purpose circuitry, or some other 
processing apparatus. Processing system 105 may execute instructions that direct processing 
system 105 to operate as described herein. The instructions could include software, firmware, 
programmed integrated circuitry, or some other form of machine-readable instructions. Thus, a 
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product may be comprised of a memory that stores the instructions. The memory could be 
comprised of a disk, tape, integrated circuit, server, or some other memory device. Processing 
system 105 could be a single device or a set of interoperating devices. Processing system 105 
could be located at a single site or distributed over a wide geographic area. 

5 

Example #2 

FIG. 2 illustrates processing system 200 in an example of the invention. Processing 
system 200 is an example of processing system 100 of FIG. 1. Processing system 200 includes 
signal processing system 201, trigger detection system 202, classification system 203, library 

10 system 204, and control system 205. 

Signal processing system 201 receives sensor signals 211 from the sensors that measure 
process characteristics. Signal processing system 201 processes sensor signals 21 1 to provide 
processed sensor data 212 to trigger detection system 202 and classification system 203. The 
signal processing could entail reformatting the sensor signals, removing noise, replacing missing 

15 or false data, or other operations that prepare sensor data 212 for systems 202-203. Replacement 

data could be the last known good value, an average value, or a user-selected default value. If 
data is replaced a given number of times within a specific time period, then an appropriate alarm 
could be generated. 

Trigger detection system 202 receives processed sensor data 212. Trigger detection 
20 system 202 processes sensor data 2 12 to determine if there is a deviation from a baseline for the 

process. In response to detecting a deviation from the baseline, trigger detection system 202 
provides trigger indication 213 to classification system 203. To detect the deviation from 
baseline, trigger detection system 202 may process sensor data 212 to produce a single logical 
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variable whose state indicates whether the process is operating normally or abnormally. When 
the process is operating abnormally, the single logical variable should cause a trigger. One 
example of a single logical variable is the angle between two unit vectors, where one unit vector 
is derived from sensor data 212 and the other unit vector from a vector library and is associated 
with an abnormal operation. Trigger detection techniques include sensor data thresholds, genetic 
algorithms, pattern recognition, neural networks, process modeling, statistical methods, or 
another suitable approach to trigger detection. 

Classification system 203 receives processed sensor data 212 and trigger indication 213. 
In response to trigger indication 213, classification system 203 processes sensor data 212 to 
classify the deviation. To classify the. deviation, classification system 203 processes sensor data 
212 to generate a process vector. The process vector represents the current state of the process - 
where the process may be operating abnormally as indicated by the trigger. 

Classification system 203 also retrieves vector library 214 from library system 204. 
Vector library 214 includes a set of stored library vectors and their associated abnormal 
operations. Examples of abnormal operations include component failure, contamination, 
operator error, unauthorized intrusion, or some other unwanted event that negatively affects the 
process. The stored library vectors are previously derived through the observation of actual 
abnormal operations or through tests that emulate various abnormal operations in order to 
associate a specific abnormal operation with a specific library vector. These observations and 
tests should use the same type of sensors and processing that produce the process vector. 

Classification system 203 compares the process vector to the library vectors to find a 
match. The match does not have to be absolute, and typically, two vectors are deemed a match if 
they are within a specified range or angle of one another. Various techniques can be used to 
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determine a match between two vectors, including a minimum angle analysis, a minimum 
distance calculation, nearest neighbor analysis, or some other vector comparison technique. If 
the process vector matches one of the library vectors, then the deviation is classified based on the 
abnormal operation that is associated with the matching library vector. If the process vector does 
5 not match any of the library vectors, then the deviation is classified as unknown. In response to 

classification of the deviation, classification system 203 transfers deviation classification 215 to 
control system 205. 

Control system 205 receives and processes deviation classification 215 to provide control 
instructions 216 to the process control systems and to provide alarms 217 to process operations. 

10 The selection of control instructions and alarms could be based on a look-up table that associates 
specific control instructions and alarms with specific abnormal operations. Control instructions 
216 and alarms 217 are used to initiate remedial action that counters the abnormal operation. 

For unknown classifications, deviation classification 215 and alarms 217 indicate the 
process vector with the unknown classification and its associated sensor data 212. Classification 

15 system 203 typically associates a unique reference number with each process vector and its 

classification, and process vectors with unknown classifications may be distinguished by their 
reference number. Personnel at process operations investigate the deviation to determine the 
associated abnormal operation. Process operations provide vector information 218 to control 
system 205. Vector information 218 specifies a new library vector - which was the process unit 

20 vector that previously had an unknown classification. Vector information 218 also specifies the 
abnormal operation to associate with the new library vector as determined by process operations. 
Vector information 218 also indicates the control signals and alarms that should be implemented 
upon subsequent classification of the abnormal operation based on the new library vector. 
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Control system 205 provides library update 219 to library system 204. Library update 
219 specifies the new library vector and its associated abnormal operation. Library system 204 
stores the new library vector and its associated abnormal operation in unit vector library 214. 
Thus, future occurrences of the abnormal operation will be automatically classified, so the proper 
remedial action can be promptly implemented. Vector library 214 could be distributed and 
shared among different processing systems at various locations, so that an abnormal operation 
discovered at one location may subsequently be automatically classified and countered at a 
different location. 

If desired, the vector library may be separated into vector groups. For example, one 
vector group could be contamination and a second vector group could be equipment malfunction. 
The sequence of the vector comparisons could be established based on the groups, so that high 
impact vector groups are processed before lower impact vector groups. Thus, the library vectors 
for dangerous contaminants could be checked before the library vectors for minor equipment 
malfunctions are checked. 

Example #3 

FIG. 3 illustrates signal processing and trigger detection system 300 in an example of the 
invention. Signal processing and trigger detection system 300 is an example of signal processing 
system 201 and trigger detection system 202 of FIG. 2. Signal processing and trigger detection 
system 300 includes delay time adjustment 301, response time adjustment 302, baseline 
estimation 303, baseline estimate subtraction 304, scaler 305, principal component analysis 306, 
distance measurement 307, comparator 308, and trigger level 309. 
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Delay time adjustment 301 receives various sensor signals from a number of sensors for 
the process. Delay time adjustment 301 time shifts the sensor signals to align the signals in time. 
This typically involves delaying the signals that arrive early to match the slowest signal in the 
time domain. Delay time adjustment 301 transfers time shifted signals to response time 
adjustment 302. 

Response time adjustment 302 shifts the slopes of the time shifted signals to align their 
response times. For example, response time adjustment 302 could use a linear filter to alter the 
response times of faster signals to match the response time of the slowest signal. Response time 
adjustment 302 transfers time and response adjusted signals to baseline estimation 303 and to 
baseline estimate subtraction 304. 

Baseline estimation 303 processes the time and response adjusted signals to determine 
baseline values for the sensor signals. Baseline estimation could utilize a moving window 
average, a Kalman filter that takes into account both process noise statistics and measurement 
noise statistics, or some other baseline determination technique. Baseline estimation 303 
transfers baseline estimates to baseline estimate subtraction 304. 

Baseline estimate subtraction 304 receives both the time and response adjusted signals 
and the baseline estimates. Baseline estimate subtraction 304 subtracts the baseline estimates 
from their respective time and response adjusted signals to determine a difference from the 
baseline estimate for each of the sensor signals. Baseline estimate subtraction 304 transfers these 
differences from the baseline estimates to scaler 305 and to the classification system. 

Scaler 305 adjusts the differences based on weighting factors that are specific to the type 
of difference. Typically, scaler 305 multiplies each difference by a specific weighting factor to 
normalize the differences, so that one difference does not vary disproportionately to the other 
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differences. Scaler 305 transfers the scaled differences to principal component analysis 306. 

Principal component analysis 306 processes the scaled differences using principal 
component analysis techniques to reduce the data set. For example, if there are five sensor 
signals, then there are five scaled differences. Some of the scaled differences may share 
redundant information. Principal component analysis 306 combines sets of scaled differences 
that share redundant information to reduce the data set. In an example with five sensor signals, it 
may be possible to combine a two of the scaled differences into one difference to reduce the data 
set from five to four differences. Other techniques to reduce the data set and remove redundancy 
could be used, or principal component analysis 306 could be omitted altogether. Principal 
component analysis 306 transfers the resulting scaled differences to distance measurement 307. 

Distance measurement 307 processes the resulting scaled differences to derive one 
logical variable that can be used to initiate the classification process if the one logical variable 
exceeds a threshold. The logical variable could be derived by squaring each of the resulting 
scaled differences and then summing the squares. Distance measurement 307 transfers the 
logical variable to comparator 308. 

Trigger level 309 provides a trigger level to comparator 308. The trigger level could be 
set by process operations, determined through empirical testing, determined based on historical 
process data, or derived through another suitable technique. To determine the trigger level based 
on historical process data, a Ljung-Box lack-of-fit analysis could be performed to determine a 
trigger level that indicates when current differences deviate from historical differences. 

Comparator 308 receives the logical variable and the trigger level. Comparator 308 
compares the logical variable to the trigger level to determine if the logical variable exceeds the 
threshold specified by the trigger level. If the logical variable exceeds the trigger level, then a 



12 



Docket #27441.002 

deviation is detected, and comparator 308 generates a trigger signal and transfers the trigger 
signal to the classification system to initiate classification of the deviation. 

FIG. 4 illustrates classification system 400 in an example of the invention. Classification 
system 400 is an example of classification system 203 FIG. 2. Classification system 400 
includes classification control 401 , scalers 402-403, unit vectors 404-405, dot product 406, 
comparator 407, and trigger level 408. 

Classification control 401 receives the differences from the baseline estimates and the 
trigger signal from the signal processing and trigger detection systems. In response to the trigger 
signal, classification control 401 logs the date, time, reference number, and differences for the 
trigger. In addition, classification control 401 retrieves a vector library from the library system. 
Classification control 401 transfers the differences to scaler 402 and transfers library vectors 
from the vector library to scaler 403. 

Scaler 402 adjusts the differences based on a weighting factor specific to each type of 
difference. Scaler 402 transfers the scaled differences to unit vector 404. Scaler 403 adjusts the 
library vectors based on weighting factors, that are specific to each component of the library 
vectors. Scaler 403 transfers the scaled library vectors to unit vector 405. Typically, scalers 402 
and 403 apply the same weighting factors to the same vector components. 

Unit vector 404 processes the scaled differences to generate a process unit vector. The 
process unit vector has a magnitude of one and an angle. Unit vector 404 transfers the process 
unit vector to dot product 406. 

Unit vector 405 processes the scaled library vectors to generate library unit vectors. The 
library unit vectors also have a magnitude of one and their respective angles. Unit vector 404 
transfers the library unit vectors to dot product 406. 
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One technique of obtaining a process unit vector is to divide each difference by the 
square root of the sum of the squares of all differences to produce a vector whose geometrical 
length is unity. The information about the magnitude of the process vector is lost by design, but 
the information about the angle of the process vector is retained. Advantageously, the use of a 
unit vector tends to work well regardless of the magnitude of the deviation. 

Dot product 406 receives the process unit vector and the library unit vectors. To get the 
angle between the process unit vector and an individual library unit vector, dot product 406 
calculates the arc-cosine of the dot product of the process unit vector and the individual library 
unit vector. Dot product 406 repeats the calculation for all of the library unit vectors and 
transfers the resulting angles to comparator 407. 

If desired, the unit vector and dot product steps described above could be combined into a 
single processing step to produce the angles from the scaled differences and scaled library 
vectors. Alternatively, the use of unit vectors could be omitted, and the process vector and the 
library vectors could be compared through some other technique to determine a match. 

Trigger level 408 stores a trigger level that indicates how close an angle must be between 
the process unit vector and a given library unit vector to find a match. The trigger level can be 
set through empirical testing or by process operations. Trigger level 408 provides the trigger 
level to comparator 407. 

Comparator 407 receives the angles and the trigger level. Comparator 407 compares the 
angles to the trigger level to determine if any of the angles fall below the trigger level. If one of 
the angles falls below the trigger level, then comparator 407 generates a match signal and 
transfers the match signal to classification control 401. 
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In response to the match signal, classification control 401 classifies the deviation by 
determining the specific abnormal operation that is associated with the library vector that 
produced the match. Classification control 401 transfers the classified deviation to the control 
system. If all of the library vectors are compared without a match, then classification control 401 
transfers an unknown classification to the control system, along with the reference number, 
deviations, and other desired data that is associated with the unknown classification. 

Example #5 

FIG. 5 illustrates water supply analysis system 500 in an example of the invention. 
Water supply analysis system 500 includes water supply 501, water main 502, valve 503, water 
main 504, sample line 505, sensors 506, signal processor 507, computer 508, water supply 
operations 509, chlorine supply 510, and color supply 511. Water supply 501 provides fresh 
potable water to water main 502. Under normal operating conditions, valve 503 is open and 
allows the water to flow from water main 502 to water main 504 for distribution to water users. 

Signal processor 507 could be a digital signal processor with firmware. Computer 508 
could be a personal computer with software. Signal processor 507 and computer 508 are an 
example of processing system 105 of FIG 1. Signal processor 507 is an example of system 201, 
and computer 508 is an example of systems 202-204 of FIG. 2. Signal processor 507 is an 
example of elements 301-304 of FIG. 3. Computer 508 is an example of elements 305-309 of 
FIG. 3 and elements 401-408 of FIG. 4. 

Sample line 505 diverts a portion of the water to sensors 506. Sensors 506 measure pH, 
conductivity, turbidity, chlorine, and total organic carbon in the water from sample line 505. 
Other measurements could include temperature, pressure, flow rate, dissolved oxygen, oxidation 
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reduction potential, chemical oxygen demand, resistivity, viscosity, ammonia concentration, 
fluoride, streaming current potential, ultra-violet light absorbance, fluorescence, and sulfide or 
other ions as measured by ion selective electrodes. Sensors 506 could be separate devices or 
integrated into a single device. Sensors 506 transfer sensor signals 512 to signal processor 507. 

Signal processor 507 processes sensor signals 512 to produce differences 513. Computer 
508 processes differences 513 to trigger when a deviation from baseline is detected. In response 
to the trigger, computer 508 processes the differences to create a process vector and then 
compares the process vector to a library of vectors to determine if there is a match between the 
process vector and one of the library vectors. If a match is found, computer 508 classifies the 
deviation by identifying the operating condition that is associated with the matching library 
vector. 

Based on the classified deviation, computer 508 produces alarms and control signals. 
Computer 508 transfers alarm 514 indicating the classified deviation to water supply operations 
509. In response to unknown classifications, computer 508 may update the vector library as 
described above. 

If the classified deviation is a contaminant in the water, then computer 508 may transfer 
control signal 515 to chlorine supply 510, and in response, chlorine supply 510 adds chlorine 518 
to water main 502 to counter the contaminant. In addition, computer 508 may transfer control 
signal 516 to color supply 51 1, and in response, color supply 511 adds colorant 519 to water 
main 502 to mark the contaminant. For some contaminants, computer 508 may transfer control 
signal 517 to valve 503, and in response, valve 503 operates to stop the flow of contaminated 
water to water main 504. 

CLAIMS: 
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